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METHOD FOR SCANNER CONTROL IN AT LEAST ONE SCAN AXIS IN A LASER 

SCANNING MICROSCOPE 

CROSS-REFERENCE TO RELATED APPLICATIONS 

[0001] This is a nationalization of PCT/EP2004/014318 filed 16 December 2004 and 

published in German. 

BACKGROUND OF THE INVENTION 

[0002] Methods for scanner control in a laser scanning microscope are described, for 

example, in US 6,037,583. 

[0003] Despite calibration (for example, by a linear electrical signal) of the scanner, 

fraying of vertical lines as the result of phase differences between the forward and back scan 
(bidirectional deviations) occurs, caused by: 

[0004] 1 . Long-term changes of scanner response 

[0005] 2. Temperature/load-related fluctuations 

[0006] 3. Zoom dependence of scanner response. 

[0007] This problem is to be corrected by the invention. 

SUMMARY OF THE INVENTION 

[0008] This task is solved by a method for scanner control in at least one scan axis in a 

laser scanning microscope, in which the scan field is subdivided into partial regions, a first image 
of at least one partial region generated by a forward scan being compared with a second image of 
the partial region generated by a back scan and a correction value being determined for the 
scanner control fi'om the deviation between the first and second images, 

[0009] In one embodiment of the invention, the step of subdividing the scan field into 

partial regions comprises dividing the scan field into strips that form the partial regions. In this 
embodiment, the slice direction of the strips lies parallel to the image edge of the scan field. 



[0009. 1] In another embodiment, the longitudinal axis of the strips during line-by-line 
scanning is perpendicular to the direction of the scan lines in the image. 

[0009.2] In still another embodiment, in the determining step, the correlation of partial 
images (that is, images of the partial regions) is determined for each scan axis. 

[0009.3] In still another embodiment, deviations are determined from the correlation of the 
partial areas. The deviations can be combined as data points for a deviation curve and this 
deviation curve is used to determine a correction value of the scanner control. 

[0009.4] The deviation curve can be correlated with the individual frequency fractions of 
the scanner control (sine curves) for determination of the correction of the scanner control and 
correction values for the scanner control are determined via the correlation values. 

[0009.5] The method can further comprise the step of storing correction values for the 
scanner control together with the time the correction values are determined. 

[0009.6] A comparison is carried out of correction values recorded at different times. 

[0009.7] The frequency of the scanner can be controlled or corrected with the determined 
correction values. 

[0009.8] In the step of subdividing the scan field, the slice direction of the partial image 
can lie parallel to an image edge of the scan field. 

[0009.9] Altematively, in the step of subdividing the scan field, the slice direction of the 
partial images can agree with a scan axis, or it can have an angle to at least one scan axis. 

[0009.10] In the step of determining a correction value, a test pattem can be used to 
determine the correction value. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

[0009. 11] Figure 1 is a diagrammatic illustration of a laser scanning microscope with a scan 
module and a detection module. 

[0009.12] Figures 2a and 2b are diagrams illustrating an example of the basic principle of 
the invention. 

[0009.13] Figure 3 is a diagram showing the slice direction of partial images used to 
determine the error of the X scaimer in accordance with the present invention. 

[0009. 14] Figure 4 shows the case of a rotated scan. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

[00010] The underlying idea of the invention is to carry out evaluation of a scan image by 
investigating it for bidirectional deviations and conducting a continuous correction of the 
coefficients for scanner control during microscope operation (for example, between scans). 

[0001 1] The invention is further explained below by means of schematic representations. 

[00012] Figure 1 shows a laser scaiming microscope LSM with a scan module SC and a 
detection module DE. 

[000 1 3] Additional details are known from US 6,63 1 ,226. 

[00014] Control of the scan module SC and detection module DE, as well as feedback of 
detection of the control state occur via a control unit AS, for example, a real-time computer. 

[000 1 5] Control unit AS is connected to a PC as a user interface. 

[0001 6] Image evaluation according to the invention and a change in control data for the 
scanner can occur in the real-time computer or PC. 

[00017] Figures 2a and 2b show an example of the basic principle. 
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[0001 8] Here the strip-like partial images B 1 , B2 for the forward and back scan are shown 
by means of a scanned cross grid sample with grid strips GS, in Figure 2a in the X scanner 
direction and in Figure 2b in the Y scanner direction. Partial images Bl, B2 are brought together 
and correlated with each other, i.e., made congruent by displacement, and the correction values 
determined. 

[00019] Figure 3 shows that the slice direction of the strip-like partial images Bl, B2 to 
determine the error of the X scanner occurs perpendicular to the X direction, i.e. in the Y 
direction (unrotated scan). 

[00020] Since the Y scanner is at rest between scan lines, determination of the error in the 
Y direction is not possible here. 

[0002 1 ] A detailed evaluation of image distortions caused by line movement of the 
scanner is possible if the image is sliced into strips perpendicular to the scan lines and each strip 
evaluated by itself The overall trend of the bidirectional deviations within a scan line is then 
obtained. Knowledge of this trend permits better correction than a simple displacement between 
forward and back lines constant over the entire image. 

[00022] Unrotated scan variant 

[00023] This means that one of the scanners operates as a fast line scanner (hereafter 
referred to as X scanner) and the other scanner as a slow line scanner (hereafter referred to as Y 
scanner). The Y scanner advantageously jumps during the reversal phases of the X scanner from 
line to line (line advance) and is at rest during actual data recording. This rotational direction of 
the scan is referred to subsequently as 0® scan angle. The slice direction for the strips is parallel 
to the image edge and also parallel to the Y direction for 0® scan angle. 

[00024] The displacement direction to determine the error of the X scanner is parallel to 
the scan direction of the X scanner, i.e., the two partial images of the even and odd scan lines 
(forward and back scan) are displaced relative to each other along the direction in the figure that 
is predetermined by movement of the X scanner, i.e., parallel to the scan lines at 0° scan. 
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[00025] A determination of the error of the Y scanner is not possible at 0° scan (Y scanner 
at rest during scan Hnes). 

[00026] Figure 4 shows the case of a rotated scan (scan angle not equal to 0**, 180"*, 90° 
and -90"^). In this case both scanners operate synchronously as line scanners. Between the scan 
lines both scanners advantageously jump during the reversal times of both scanners to the next 
line. By adjusting the scan amplitudes of both scanners, the scan angle (orientation of the scan 
line in the sample) is adjusted. In this case the slice direction for the strip-like partial images 
occurs at an angle to the scan directions X and Y. The slice direction also lies here essentially in 
the edge direction of the scanned image. 

[00027] To determine the error of the X scanner, a shift of the partial images from the 
forward and back scan occurs in the X direction (that is, in the direction of the X scanner, not the 
direction of the scan lines), to determine the Y error in the Y direction (that is, in the direction of 
the X scanner, not the direction of the scan lines). 

[00028] The corresponding correction is determined in each case and the correction vector 
determined from both values. 

[00029] Rotated scan variant, i.e.. scan angle not equal to 0°. 90\ -90° and 180°; 

[00030] The X scanner and Y scanner move quickly and both scanners jump a little bit 
between lines. 

[0003 1] When both scanners start simultaneously with the same amplitude, the light point 
in the sample does not move from left to right but from bottom left to top right (for example) 
[[-> ]] - greater than 45° rotated scan. If the Y scanner moves with only half amplitude, the light 
spot goes from bottom left to the half top right [[->]] - greater than about 22° scan angle. [[..]] 
Between the rotated scan lines, both scanners jump a little bit (constant offset of movement 
superimposed) so that the next scan line lies next to the last one. 

[00032] The slice direction for the strips is also advantageously parallel to the image 
edge, perpendicular to the direction of the scan lines. 
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[00033] The displacement direction to determine the error of the X scanner is parallel to 
the scan direction of the X scanner, i.e., the two partial images of the even and odd scan lines 
(forward and back scan) are displaced relative to each other along a direction of the image 
predetermined by movement of the X scanner (the direction along which the light spot would 
move in the sample if the X scanner were moved alone). 

[00034] The displacement direction to determine the error of the Y scanner is parallel to 
the scan direction of the Y scanner. 

[00035] It can also be useful, in order to determine the time trend of the image distortion, 
to also break down the image parallel to the direction of the scan lines. 

[00036] In a rotated scan the scanner is scanned not along the scan lines but "obliquely" 
through the image. The directions of both scan movements are then essential for the bidirectional 
deviations, not the direction of the scan lines. 

[00037] Determination of the bidirectional deviations occurs as follows: 

[00038] - Slicing of the image into (for example) 10 equally wide strips, preferably 
along the slow scan axis (slice perpendicular to the fast axis) 

[00039] - Slicing of the strips in the two partial images from the forward scan and 
back scan (if necessary filling in the missing lines with the average value of the adjacent lines) 

[00040] - Calculation of (one-dimensional) cross-correlation functions of the two 
partial images along the two scan directions (the following evaluation occurs for both scan 
directions in order to be able to correct both scanners) 

[00041] • during displacement of the two partial images relative to each 

other, all of the image data can actually be utilized, i.e., missing data in the edge region of the 
partial images are taken from the neighboring strips 

[00042] - Evaluation of these correlation functions: 
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[00043] • position of the maximum: at this displacement length the two 

partial images best fit each other, i.e., this displacement is the desired correction of the 
bidirectional deviation on the image position on which the strip is situated 

[00044] • half-width and half-height of the peak: gauge of the accuracy of 

measurement. The cross correlation function is normalized, for example, to the autocorrelation(s) 
of the two partial images, i.e., a correlation of 1 means that the two partial images agree exactly 
during this displacement. 

[00045] - At rotation angles that deviate less than (for example) 10° from the main 
axis of the scanner, only this scanner should be evaluated (for example, in a 0° scan only the X 
scanner can be evaluated) 

[00046] - The position of the peaks of the individual image strips yield a curve per 
scan direction (x, y) with, for example, 10 data points (number of image strips) for the 
bidirectional deviation in the image. 

[00047] - Depending on the accuracy of the measurement (half-width and half- 
height of the cross-correlation peaks) these data points should advantageously be marked with 
weighting factors or, if unusable, discarded. 

[00048] Correction of the scanner control occurs advantageously via the coefficients of a 
Fourier series from the signal curves of the scanner control signals. 

[00049] The correction of the scanner coefficient then occurs as follows: 

[00050] - Determination of the scanner coefficient that best corrects the found 
deviation curve. Correlation of the measured deviation curve with sin(lf), sin(2f), sin(3f), ... 
(which coefficient yields the maximxmi correlation with the measured deviation curve) , where If. 
2f, 3f. ... are the individual fi-equencv fractions of the scanner control 

[0005 1 ] - The phase error of the coefficient can be calculated firom the correlation 
value (large amplitude of the deviation curve = large phase error of the coefficient). When the 
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deviation is caused only by a coefficient, a sine curve with nodal points at the reversal points of 
the scanner is always present (outside of the imaged 

[00052] - Correction of the phase of the coefficient (amplitude is advantageously not 
changed in order to obtain the long-term linearity of scanner movement). 

[00053] - The phase of the concerned coefficient could also not be fully corrected, 
depending on the quality of the measurement (weighting factors, see above). The finally valid 
correction then occurs, for example, during the next scan images. 

[00054] - In this way with each scan (at least) one coefficient could be corrected. By 
correlation of the deviation curve with several scanner fi*equencies, several coefficients can also 
be corrected in one step (depending on the accuracy of measured values). 

[00055] Over time a parameter field can be produced on the control computer of the 
microscope with scanner coefficients that are permanently adjusted. 

[00056] The parameters are, for example: speed, zoom (for example zoom 0.7, 0.8, 1, 2, 4, 
8). 

[00057] If an intermediate zoom is used, interpolation can occur fi-om neighboring 
coefficients and in similar fashion the neighboring coefficients (also with weighting) can be 
adjusted after a deviation measurement. 

[00058] The parameter field on the hard disk can only slowly change advantageously (for 
example, weighted average between daily average and present value in the files). 

[00059] In addition, a fiirther relatively rapidly variable parameter field can occur in that a 
reaction occurs to temperature fluctuations during the day (according to possibility, evaluated 
after each image). 

[00060] A correction of the active coefficient could also occur during deviations greater 
than a predetermined threshold (for example, a value adjustable by the user). 
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[00061] This parameter field is also recorded and stored. 

[00062] Depending on the deviation width and quality of this day-parameter on 
completion of the LSM program, the field stored on the hard disk could be adjusted (possible 
parameters for weighting: deviation width of the measured deviations, value number, operating 
hours, etc.). The on-line correction can be switched off, i.e., the user can have the possibility of 
activating or suppressing the mechanism of automatic correction of the scanner control. The 
original calibration set from the plant can be stored for evaluations of development of the 
mechanical and electrical behavior of the scanner and the copy can be permanently stored. The 
parameter set on the hard disk can also be reset (by means of the original calibration). 

[00063] A comparison of the formed parameter set with the original set could lead, for 
example, to a recommendation on the screen for the user "Please calibrate the scanner again" 
(the threshold value could be different according to scan speed). 

[00064] In multichannel images (during the scan different data are recorded, for example, 
for each image pixel with several detectors) all channels could be evaluated and compared 
separately (the scarmer-related image distortion should be the same in all images). 

[00065] Through the described correction, in addition to approved bidirectionality, an 
improvement in linearity is also possible, since the coefficients can be exactly shifted with 
reference to their phase. 
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